View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0001739 | T99X171.00 SKB Eagle | xTS certification | public | 2023-06-13 12:43 | 2023-07-24 12:15 |
| Reporter | (ALTech) Younkwang Jung | Assigned To | (ALTech) Younkwang Jung | Due Date | 2023-06-16 13:41 |
| Priority | normal | Severity | s4-minor | Reproducibility | always |
| Status | closed | Resolution | fixed | ||
| Summary | 0001739: [Smart3][ATV10][ATV12] GTS - GtsMediaTestCases Fail in GTS 10_r4 | ||||
| Description | Hi Kerwin The GTS GtsMediaTestCasesFail issue in GTS 10_r4 has been resolved by Amlogic. https://jira.skbroadband.com/projects/AMANDROIDS/issues/AMANDROIDS-114 Please proceed with GtsMediaTestCases after applying the patchs belows. ( attached picture ) These can be applied to ATV10/ATV12. (Common Patchs) Please let me know the result after the test. Thank you. YK.Jung | ||||
| Tags | No tags attached. | ||||
| Attach Tags | |||||
| User List |
(ALTech) JunGyu Kim , (ALTech) SY Yoon |
|---|
|
|
|
|
|
HI Jason AML reported the information incorrectly. The above patches are for ATV12. I will send the patchs for ATV10 as soon as I get it. Thank you YK.Jung |
|
|
Hi YK, After applying the patches, the result still fails run gts -m GtsMediaTestCases -t com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60 06-13 15:36:18 I/ModuleListener: [1/1] SKBFXYU4133L com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60 FAILURE: android.media.NotProvisionedException: Failed to open session: ERROR_DRM_NOT_PROVISIONED ============================== Beginning of DRM Plugin Log ============================== 06-13 16:36:18.159 I found instance=clearkey version=android.hardware.drm@1.4::IDrmFactory 06-13 16:36:18.159 I found instance=default version=android.hardware.drm@1.0::IDrmFactory 06-13 16:36:18.159 I found instance=playready version=android.hardware.drm@1.4::IDrmFactory 06-13 16:36:18.159 I found instance=widevine version=android.hardware.drm@1.4::IDrmFactory 06-13 16:36:18.162 W [device_files.cpp(1701):RetrieveHashedFile] File does not exist: path = /data/vendor/mediadrm/IDM1013/L3/usgtable.bin 06-13 16:36:18.162 E [device_files.cpp(1559):RetrieveUsageTableInfo] Unable to retrieve usage table file 06-13 16:36:18.162 W [usage_table_header.cpp(200):RestoreTable] Could not retrieve usage table ============================== End of DRM Plugin Log ============================== |
|
|
Hi Jason I have reported it to AML. feedback is AML is requesting to proceed with the entire test using the command below. run gts -m GtsMediaTestCases This means that the FXN will fail if only the following test is performed "run gts -m GtsMediaTestCases -t com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60" and AML is saying that if FXN proceed with the entire test, FXN will get a pass. So please test using the command below "run gts -m GtsMediaTestCases" Thank you YK.Jung |
|
|
Hi YK, Regarding the GTS failures, before I apply the patch if I run the single test case, I'll get the following failure, 06-13 15:36:18 I/ModuleListener: [1/1] SKBFXYU4133L com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60 FAILURE: android.media.NotProvisionedException: Failed to open session: ERROR_DRM_NOT_PROVISIONED ============================== Beginning of DRM Plugin Log ============================== 06-13 16:36:18.159 I found instance=clearkey version=android.hardware.drm@1.4::IDrmFactory 06-13 16:36:18.159 I found instance=default version=android.hardware.drm@1.0::IDrmFactory 06-13 16:36:18.159 I found instance=playready version=android.hardware.drm@1.4::IDrmFactory 06-13 16:36:18.159 I found instance=widevine version=android.hardware.drm@1.4::IDrmFactory 06-13 16:36:18.162 W [device_files.cpp(1701):RetrieveHashedFile] File does not exist: path = /data/vendor/mediadrm/IDM1013/L3/usgtable.bin 06-13 16:36:18.162 E [device_files.cpp(1559):RetrieveUsageTableInfo] Unable to retrieve usage table file 06-13 16:36:18.162 W [usage_table_header.cpp(200):RestoreTable] Could not retrieve usage table ============================== End of DRM Plugin Log ============================== if I run the whole module, some test video will be stuck at the last frame. and It happens randomly in different test case as follows, com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With240P60 com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With720P60 com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60 com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3WithUHD60 After apply Amlogic today's patch, I still can see this symptom randomly. You can told Amlogic Korean FAE to monitor OTT-44245, it's Amlogic internal Jira number. Their RD said there are something wrong in Google streaming server, they are waiting Google's reply. Thanks, Jason |
|
|
Hi YK, Please check the attachments, The test video will be stuck at the last frame, Please refer to symptom.png And test result will failure because timeout occur. Thanks, Jason |
|
|
Hi Jason > Is the issue below caused by not being provisioned? As far as I know, only the FXN model is not provisioning. This could be a serious matter, so please check it. ======================================================= 06-13 15:36:18 I/ModuleListener: [1/1] SKBFXYU4133L com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60 FAILURE: android.media.NotProvisionedException: Failed to open session: ERROR_DRM_NOT_PROVISIONED ============================== Beginning of DRM Plugin Log ============================== 06-13 16:36:18.159 I found instance=clearkey version=android.hardware.drm@1.4::IDrmFactory 06-13 16:36:18.159 I found instance=default version=android.hardware.drm@1.0::IDrmFactory ======================================================= > About video struck issue I reported it to AML https://jira.skbroadband.com/browse/AMANDROIDS-115 > About GtsMediaTestCases Please proceed with the all GtsMediaTestCases and let me know the results Thank you YK.Jung |
|
|
Hi YK, >>As far as I know, only the FXN model is not provisioning. incorrect, you can check the original Jira, I don't know which manufacturer reported it, but their log is not provisioning. Currently, according to Amlogic comment, we can NOT run "Single" item, if we run the single item, I think all manufacturer will get the same log "ERROR DRM NOT PROVISIONED" whether we apply the patch or not. so if need to retry this failure, we should run the whole gts module run gts -m GtsMediaTestCases or run the the package run gts -m GtsMediaTestCases -t com.google.android.media.gts.WidevineVP9WebMPlaybackTests Thanks, Jason |
|
|
Hi YK, Our QA run the GtsMediaTestCases today, the 1st round, we have 4 failures, com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With240P60 com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With720P60 com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60 com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3WithUHD60 Our QA retry again and again, each round might eliminate one failure (but not 100%), please check the history.jpg The final result in today, we still have one failure. I think we should clarify it before submit the FW to 3PL.. (ATV10 also have this issue) Because we can't guarantee that we can get all passed results within 3~4 retries. There is a 2 minute timeout for every failure, which is a huge waste of time for 3PL. I don't have strong reason to ask 3PL to retry again and again. For the problem of being stuck on the last frame, as far as I know, Amlogic RD has created an issue tracker to discuss with Google. Please ask Korea Amlogic FAE to track this issue. Thanks, Jason |
|
|
Hi YK, Our QA finished the GtsMediaTestCases test with 6 times retries if the certification is Self-Test, I think it is OK. but if the certification is on 3PL side, I think these cases are not stable. For ATV10, We'll do the certification on 3PL side, please ask Amlogic to keep track this issue. Thanks, Jason |
|
|
Hi Jason Amlogic did a Google test on GtsMediaTestCases for BFX-AT100(ATV10) and The test result is pass. Test FW is v15.536.32 In the case of ATV10, it seems that it is possible to prepare for Google approval through self-build? Do you happen to have any other Google issues at ATV10 ? Please check it Thank you YK.Jung |
|
|
Hi Jason setprop vendor.media.omx.out_buffer1 10 setprop vendor.media.omx.out_buffer2 20 AML FAE says that if you test it after setting up the above property, it will pass more stably Please check it. (ATV10 / ATV12 are both the same) Thank you YK.Jung |
|
|
Hi YK >>setprop vendor.media.omx.out_buffer1 10 >>setprop vendor.media.omx.out_buffer2 20 >>AML FAE says that if you test it after setting up the above property, it will pass more stably This information that Amlogic QA has verified last week, it was not work, so Amlogic RD created the issue tracker to discuss with Google Now this issue is under discussion. Please ask Amlogic FAE to monitor monitor OTT-44245. Thanks, Jason |
|
|
Hi Jason The current high priority is Google approval through ATV10 3PL. (UI536 FXN self-build version) So I asked AML for quick support for ATV10 As a result, I received the result that GtsMediaTestCases was passed by GTS_10_r4 ATV10. ( I received the test result from AML after setting below.) setprop vendor.media.omx.out_buffer1 10 setprop vendor.media.omx.out_buffer2 20 What you're saying is When the Google test was conducted with ATV10 at FXN, the results of GtsMediaTestCases (GTS 10_r4) were Fail Please send me the failed content(log and test result) we have to double check with AML. Thanks YK.Jung |
|
|
Hi YK, the user build have no permission to setprop vendor.media.omx.out_buffer1 10 setprop vendor.media.omx.out_buffer2 20 BFX-AT100:/ $ setprop vendor.media.omx.out_buffer1 10 Failed to set property 'vendor.media.omx.out_buffer1' to '10'. 3PL do not accept setprop. unless we have the strong reason to convince 3PL. (e.g. skip dns) Currently, this issue is under discussion between Amlogic and Google, Before clarifying, I have built 15.536.60-self-0615 to our QA, they started test from Yesterday. /release_by_fxn/tmp/15.536.60-self-0615 if Google said that this is known issue, After our QA compete the pretest, we can submit the self-build to 3PL directly. >>Please send me the failed content(log and test result) The test result I've sent to Amlogic Taiwan FAE, the symptom is video get stuck at last frame, Amlogic Taiwan FAE said other manufacturer also reported it. That is why I ask Amlogic Korean FAE to monitor their internal Jira OTT-44245. Thanks, Jason |
|
|
Hi YK, For your information, Amlogic Taiwan FAE shared the attachment to us this morning. Thanks, Jason |
|
|
Hi jason Aml FAE says the new GTS 10 r4 tool is built. Could you check the existing failed item with this new tool "GTS 10 r4 build (10344474 or later)" at ATV10 (self-build version) ? Thank you YK.Jung |
|
|
Hi YK, I don't know where to download this version, I'll ask to our 3PL. Thanks, Jason |
|
|
Hi YK, I've checked it with our 3PL. they also don't have permission to get GTS daily build. The GTS daily/test build is provided by Google. It's not public. If Soc vendor can share it. I can help verify. We need GTS10 R4 (10344474) for (ATV10), (ATV11-13) => 2 zip files for ATV10 and ATV12. I am checking it with Aml Taiwan FAE, but I can not guarantee if he has permission to share this file to us. Thanks, Jason |
|
|
Hi Jason I just received a message from AML that a new Google internal version tool has been released new GTS tool "the android-gts-11-R1(11-14)-Preview17-10324228.zip" Please use this tool to check ATV10(high priroity)/ATV12 for GTS Fail and let me know the result after the test Thank you YK.Jung |
|
|
Hi YK, >>I've checked it with our 3PL. they also don't have permission to get GTS daily build. >>The GTS daily/test build is provided by Google. It's not public. If Soc vendor can share it. I can help verify. Please ask Soc vendor to provide the tool. Thanks, Jason |
|
|
Hi YK, I run the GtsMediaTestCases with android-gts-11-R1(11-14)-Preview20-10361901.zip the class WidevineVP9WebMPlaybackTests has been removed. so we can not verify it, Is it correct? Please check it with AML. Thanks, Jason |
|
|
Hi Jason The AML FAE says it has been changed to the command below. run gts -m WvtsDeviceTestCases -t com.google.android.wvts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL1WithUHD60 Please check it. Thank you YK.Jung |
|
|
Hi YK, I use the following command, please check the attachment run gts -m WvtsDeviceTestCases -t com.google.android.wvts.WidevineVP9WebMPlaybackTests first run: 2 failures, and we take 2 times retry to eliminate the failures. By the way, Google changed the test case name in preview tool. so we can not use the preview tool's result to eliminate the failure in current tool. (because test case name are different) We still need to spend time retrying and retrying until we can get past all the failures. Thanks, Jason |
|
|
Hi Jason, 1. Amlogic wants the test report (zip file) and log when the result is all passed. Could you please share test report and log file. 2. Additionally, they want the report file and log when first run (when 2 failures). 3. Also can you share that the screen capture the google system when fail contents is still remain? Thank you. Kim |
|
|
Hi JunGyu, 1. Please refer to WidevineVP9WebMPlaybackTests-report.zip/WidevineVP9WebMPlaybackTests-log.zip 2. I test it again this afternoon, we get all pass at the first run 3. please refer to GoogleSystem.jpg. I used GTS 10_R4 to run gts -m WvtsDeviceTestCases -t com.google.android.wvts.WidevineVP9WebMPlaybackTests There are 4 failures (get stuck at the last frame => timeout) Then I used android-gts-11-R1(11-14)-Preview20-10361901.zip to run gts -m WvtsDeviceTestCases -t com.google.android.wvts.WidevineVP9WebMPlaybackTests. The report is clean. I uploaded the both reports. As you can see, the failures still be shown. (expected result is the failures will be move to "Aggregated Pass" section, but the module name is different, so the 1st run failure can not be eliminated by 2nd run clean report). Thanks, Jason |
|
|
Hi Jason, To solve third issue, please contact 3PL with above information. Amlogic recognize this issue and they are contacting Google to solve this problem. But they want to push 3PL together to solve this issue quickly. Thank you. Kim |
|
|
Hi Jason It's Google feedback. ( AML updated to jira. ) https://jira.skbroadband.com/browse/AMANDROIDS-115 Thank you YK.Jung |
|
|
Hi YK, We've run the android-gts-11-R1(11-14)-Preview20-10361901.zip with 15.537.42 There is an Incomplete Modules "GtsAdServicesTestCases", please check the attachment Analysis: Failed to parse APK file: /data/local/tmp/GtsAdServicesTestCases.apk: Requires newer sdk version #33 (current version is #31) It looks like this module only works on Android 14 (SDK#33) device, but our device is Android 12 (SDK#31) Please forward to Amlogic to confirm if this is known issue, can we ignore it ? Thanks, Jason |
|
|
Hi Jason I received the following feedback from AML FAE. =========================================================== auto-waiver 처리 건으로 보입니다. from Harman feedback they said those failed will be autowaive when upload the report to APA =========================================================== Can you double check on FXN's 3PL for this part? Thank you YK.Jung |
|
|
Hi YK, We uploaded the GTS preview build report (15.537.54) to Google System The system doesn't show the any failure/warning about Incomplete Modules. so I think we can ignore it. (Incomplete Modules "GtsAdServicesTestCases") Thanks, Jason |
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2023-06-13 12:43 | (ALTech) Younkwang Jung | New Issue | |
| 2023-06-13 12:43 | (ALTech) Younkwang Jung | Status | new => assigned |
| 2023-06-13 12:43 | (ALTech) Younkwang Jung | Assigned To | => (SW) Kerwin Chen |
| 2023-06-13 12:43 | (ALTech) Younkwang Jung | File Added: image.png | |
| 2023-06-13 12:43 | (ALTech) Younkwang Jung | Issue Monitored: (ALTech) SY Yoon | |
| 2023-06-13 12:44 | (ALTech) Younkwang Jung | Issue Monitored: (ALTech) JunGyu Kim | |
| 2023-06-13 12:46 | (ALTech) Younkwang Jung | Description Updated | View Revisions |
| 2023-06-13 13:33 | (SW) Kerwin Chen | Assigned To | (SW) Kerwin Chen => (SW) Jason Ling |
| 2023-06-13 14:38 | (ALTech) Younkwang Jung | Note Added: 0013350 | |
| 2023-06-13 15:39 |
|
Note Added: 0013354 | |
| 2023-06-13 16:49 | (ALTech) Younkwang Jung | Note Added: 0013357 | |
| 2023-06-13 19:23 |
|
Note Added: 0013366 | |
| 2023-06-13 19:30 |
|
Note Added: 0013367 | |
| 2023-06-13 19:30 |
|
File Added: symptom .jpg | |
| 2023-06-13 19:30 |
|
File Added: timeout.jpg | |
| 2023-06-14 08:09 | (ALTech) Younkwang Jung | Note Added: 0013370 | |
| 2023-06-14 08:32 |
|
Note Added: 0013372 | |
| 2023-06-14 19:13 |
|
Note Added: 0013381 | |
| 2023-06-14 19:13 |
|
File Added: 1st.jpg | |
| 2023-06-14 19:13 |
|
File Added: history.jpg | |
| 2023-06-15 08:35 |
|
Note Added: 0013383 | |
| 2023-06-15 15:51 | (ALTech) Younkwang Jung | Note Added: 0013390 | |
| 2023-06-15 15:51 | (ALTech) Younkwang Jung | File Added: image-2.png | |
| 2023-06-15 15:51 | (ALTech) Younkwang Jung | Note Edited: 0013390 | View Revisions |
| 2023-06-15 18:28 | (ALTech) Younkwang Jung | Note Added: 0013391 | |
| 2023-06-15 21:50 |
|
Note Added: 0013394 | |
| 2023-06-16 08:53 | (ALTech) Younkwang Jung | Note Added: 0013397 | |
| 2023-06-16 09:53 |
|
Note Added: 0013402 | |
| 2023-06-19 10:28 |
|
Note Added: 0013430 | |
| 2023-06-19 10:28 |
|
File Added: gts.png | |
| 2023-06-20 15:19 | (ALTech) Younkwang Jung | Note Added: 0013468 | |
| 2023-06-20 15:40 |
|
Note Added: 0013469 | |
| 2023-06-20 16:39 |
|
Note Added: 0013472 | |
| 2023-06-26 09:44 | (ALTech) Younkwang Jung | Note Added: 0013492 | |
| 2023-06-26 10:07 |
|
Note Added: 0013494 | |
| 2023-06-26 13:35 |
|
Note Added: 0013497 | |
| 2023-06-26 13:35 |
|
File Added: GtsMediaTestCases.jpg | |
| 2023-06-26 14:35 | (ALTech) Younkwang Jung | Note Added: 0013498 | |
| 2023-06-26 17:43 |
|
Note Added: 0013500 | |
| 2023-06-26 17:43 |
|
File Added: WvtsDeviceTestCases.jpg | |
| 2023-06-27 12:35 | (ALTech) JunGyu Kim | Note Added: 0013509 | |
| 2023-06-27 12:40 | (ALTech) JunGyu Kim | Note Edited: 0013509 | |
| 2023-06-27 19:35 |
|
Note Added: 0013514 | |
| 2023-06-27 19:35 |
|
File Added: WidevineVP9WebMPlaybackTests-report.zip | |
| 2023-06-27 19:35 |
|
File Added: WidevineVP9WebMPlaybackTests-log.zip | |
| 2023-06-27 19:35 |
|
File Added: GoogleSystem.jpg | |
| 2023-06-28 09:01 | (ALTech) JunGyu Kim | Note Added: 0013515 | |
| 2023-06-30 12:31 | (ALTech) Younkwang Jung | Note Added: 0013535 | |
| 2023-06-30 12:31 | (ALTech) Younkwang Jung | File Added: image-3.png | |
| 2023-07-04 09:09 |
|
Note Added: 0013551 | |
| 2023-07-04 09:09 |
|
File Added: GtsAdServicesTestCases-report.zip | |
| 2023-07-04 12:44 | (ALTech) Younkwang Jung | Note Added: 0013556 | |
| 2023-07-04 12:44 | (ALTech) Younkwang Jung | File Added: image-4.png | |
| 2023-07-05 16:29 |
|
Note Added: 0013572 | |
| 2023-07-07 16:04 |
|
Assigned To | (SW) Jason Ling => (ALTech) Younkwang Jung |
| 2023-07-07 16:19 |
|
Status | assigned => resolved |
| 2023-07-07 16:19 |
|
Resolution | open => fixed |
| 2023-07-24 12:15 | (ALTech) Younkwang Jung | Status | resolved => closed |
.png)


.png)


.png)
.png)